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ABSTRACT 

This paper describes what in the area of assessment 
is essential knowledge for a prospective teacher. The listings of 
topics which would be relevant for £ course in measurement for 
preservice teachers are presented as they might appear in a course 
syllabus. For each topic, the rationnale for its inclusion is given, 
as well as the skills which would be developed and the specific 
subjects the topic would include. The eight content areas are: (1) 
basic concepts and terninology of assessment; (2) uses of assessment 
(3) assessment planning and development; (4) interpretation of 
assessments; '5) description of assessment results; (6) evaluation 
and improvement of assessments; (7) feedback and grading; and (8) 
ethics of assessment. (JD) 
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<Jn> z^CQLit Pic-'-* the? ve^^c:h&r- eaijri^r :.c:n D^-c?gr^^msi :n tr.e nr^rion 
cumen-'-.iv '-ecui^-e a course in measur-^emen t tor initial cert it icat lor 
^Scha-er ^.na L.3S5ntn, 1987^. Trus: ntatemenl- could have been made" c.^- c^nv 
time over Hhfe oa-t thiniy yearn CRoeder, 1^7.:, 1973: Noll, 1955). howe /er . 
when such c> coursse : 5e ]r. eluded ]n a v=i:udent'?: program, ]t o+ten doen not 
include wnat .i= important tor tt^ache^-5 to !• now , a-r juaged by t:each£?r5 , 
themselves! -'Gu 1 1 } cf Eon . : ■ , and iter crontent ih not what teachers who 
have ta{- en n: commonly use :r. Dracmce ''^Stlggl^5, 19BT'/ . 



While the reasons tor de-fjciencies ]n measurement educatjon tor manv 
teachers are unclea^^, perhaps to be included among them are (1; inettective 
communication ot the importance o-f assessment concepts and methods tor 
et-Fective teachino and (2,^ 1 ac^ o-f a c:ear e;:pression on the part o-F the 
measurement c:ofnmun]tv about what should be included in that train:! ng. 

The DLl^^nose o-T this paper is to attempt to describe what in tne area 
of assessment is essentjai knowledge -^'or a teacher, to do so }n a wav whict 
can De communicated to the broad educat ionf>l community, to provide :? 
justi-f jcatior- tor each area ot content, and to give an ejjpansion -For each 
in terms ot topics that might be included in instruction. The importance 
DT including each area is developed in a rationale which draws upon various 
sources, including tormal statements by pro-f essional associations, 
positions ot teachen associations or their representatives, and relevant 
literature about the needs and activiiiies ot teachers. 

Tne listings ot topics which would be r^el evant tor instruction ^n each 
content area are presented as thev might appear in a highly spec:-fic course 
syllabus. These are drawn trom te.^tpoo^ s in measurement as well as 
published 1 i teratu^-^e . While the content areas and the sKxlls are intended 
eventua'J 1 y' to be prescriptive, the lists ot topics are not. Indeed, thev 
are probably 3t once incomplete and too numerous -for a single course. Tnev 
are intended both to serve as ampl ] -f i cat 3 ons o-f the content areas and to be 
usee as a source o-f suggestions for measurement instructors as thev de-fine 
their own courses in educational nrieasurement . 

This ettort is intended to be part o-f a p^^ocess by which the 
measu^•^ement community can de-fine that body o-f content which all teachef^s 
should have a command over. For example, an eventual result o-f such wort 
might be a -formal statement by NCME about the speci-fics o-f teacher 
education in measurement. 



Presented at the Annual Meeting o-f the Nation^^l Council on Measurement in 
Education; San Francisco, CA : March 29, 1989. 

^ QThe author app^-^ec 3 ates reviews o-f ear^l3^^~ drafts of this content bv the 

^Characters o+ the Learner Tas^ Fores ot" the Mar > land State LteoartmePt of 
^ .£ducat ion . 
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RATIONALE 1 



Bas-ic Concreotr and Terminology d+ Hss;6?ssiment 

E;:Diain the purooses and techniaueB o-f assessment and criteria 
Tor tneir success; use the 1 anguc^ge 0+ measurement prec iselv 



Asse=3Sing , grad ing , 
an one of teacher 's 
Thornton, and SI- urn i^ , 
teachers can spend up 
on assessment-rel ated 
Smithy Silverman, and 
that al 1 teacher- need 



and eva } uat ing 
s S} core job 
1996^ and 1 
to one-th ird 



studenrs has been laenti-^'ied 
-functions: (Rosent el d , 

has been i oun d that 
oi their ' in5=truct lona I time 
activities (Stiggins, 19S7) . Indeed, 
Borg (1980) and Gull 1^ sen (3 986) argue 
assessment s^ xl 1 s to De e-Ftective . 



Recogn ] t j on o-^ the 3 mport ancc^ oi measurement s^ i H s -for 
teachers is inaicated b\* the National Education Association s 
pos3t3on that te^^chers need to test (NEA, 1^83^, Shan^er'H 

(19"^^./ position that a teacner s ability to assess pupil 
performance is critical to success, and the inclusion o-f 
diagnosis as one o-f the five skill components on the National 
Teacher E-.amination (Huf ker, 1982) . An understanding of the 
concepts and language of measurement is a prerequisite for 
effective study of the techniques of assessment. It is 
particularly important that teacher education programs include 
this content because measurement eiipertise 3s not, in general . 
available to teachers 

(Stiggjnc: , 1987) . 



in the field from anv other source 



TOPICS: aefinitions of assessments, tests, performances, products, 
projects, observat 3 ons , 3nterviews, and evaluations: 

methods of assessment ^e.g., teacher-made, paper-and-penc 1 1 tests; 
te)^ t-embedded , paper- and-penc 1 1 tests; performance assessments: 
oral questions: homewor^k and seatwork assignments; standardized 
tests ; opinion? of others : group assessments) 

formative and summative assessment 

norm-referenced and cr 3 tenon-referenced assessment 
objectives and domains of objectives 

acc oun tab 1 1 3 ty and mini mum competency test ing programs 
reliability, validity, and objectivity 



CONTENT: 
SKILLS: 

RATIONALE; 



Uses of Assessment 

Identify the wavs in 
and other educators ; 
to their goa 1 s 



which measurements a^e used bv teachers 
relate info^^mat^on needs for assessments 



Tests: and other measurement methods are be3ng used to meet a 
broad variety of needs (Newman and Stal 1 ings , 198Z ; St iggin= . 
ConMin, Bridgeford, Green, and Brodv , 3987). The contejcts in 
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learner =i 



oage 



DUPDQBe o*^ an aaBesBmenr. should bte a ae'*ie''-^minsr o-^^ both the 
act 3/3 ties used f*nd evc-^luatjons of their success. 



needs 



TOPICS: gor-l s o-f assessment: 

diagnosis oi individual student 
diagnosis o+ group needs 
determining 2 nterests 
monitoring prog^-ess toward goals 
assignment oi grades 
•formation oi instructional 
identx t icat ion o-f students 
motivation o-f students 

instructional e+-f ect } veness 
1 n St 1 tut ion a 1 e+-f ect 1 veness 
o-f achievement expectations 
o-f behavioral ejjpectat ions 
test-tak j.ng expe»"ience 



groups within a class 
-for special services 



evaluation o-f 
evaluation o-f 
commun 1 cat ] on 
c ommun 1 c a 1 1 o n 
provision o-f 



accountability tor student learning 
assessment as an instructional strategy 
prediction o-f success in a program 
certi-f icaton o-f competency 
inf ormat ion criteria: 
amount o-f in-f ormat ion 
specificity o-f in-formation 
degree o-f reliabil:ty 
e;^tent of validity 
degree of interpretabi 1 ity 
protection for consequences of error 
availability for decision making 
practical ity of use 



CONTENT: Assessment Planmng and Development 

SKILLS: Define and sample content domains for measurement: describe the 

range of sources of quantitative and qualitative data; apply 
decision criteria to select appropriate assessment forms; 
ejiplain how assessment tools are best developed or located, 
selected, and administered 



RATIONALE: 



Test use includes making decisions about what to test and which 
sorts of tests to use, but more than half the tests used b/ a 
majority of teachers are constructed by the teachers, 
themselves (Newman and Stal lings, 1982). The processes 
involved include domain specification, content sampling, 
writing of probes, test assembly, administration, and scoring. 
In order to be e-^fective in these assessment roles, the teacher 
should be aware of goals for each process, and be able to 
select and apply technjques designed to meet them. The current 
National Council for Accreditation of Teacher Education 
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5tanda^-^as rei-'iecr.H the imoortance this content Dv inciur^mg 
"det-S3cjp fine itse at ev;^iUc<tion ana measurement methods" f-^nd 
''knowledge o+ di + -ferent arsessment techn i cues within its 

prot ess lunf-l stud 3 es component (NCATE , i 9B6 , p . 29 ) , 
Additionally, the American Association o-f Colleges o-^ Teache*- 
Education's (39S8; outline o+ the knowledge base -for the 
beginning teacher includes how tc evaluate l^arninc outcomes 
within a chc(pter^ on knowledge oi instruction. 

TOPICS: development ot Dehavio^^al objectives 

taj.onomic structure o-f the cognitive domain 
taj-onomic structure o-f the a + -fective domain 
selection o-f assessment methods 
test spec i-f icat ion tables 

test tvpes and their advante-?geH and disadvantages 
item writing tor all levels ot thln^ ing si- 1 1 t s 
cri t erj on-re-f erenced r:coring rules f^nd recommendat ] ons 
no'-m-re+erenceo scoring rules and recommendations 
item tDan^ : ng 

test assembl y , dupl icat ion , and admin i strat i on 

cl assit ication o-f standard il' ed tests 

ejcampl es o-f standardized tests 

locating and evaluating standardized tests 

development and use o-f per-formance assessments 

testing special populations 

intormation needs assessment 

preparing students -for testing (e-g., coaching, dealing with test 

an)(iety and test wiseness, usse o-f sample tests) 
observa.t ion o-f ind i vidual students 
observation o-f group interactions 
recording and using observat lonal data 
paper and pencil questionnaires 
personal and qroup int erv i ews 
using opinions o-f others 
using student records 



CONTENT 



Interpretat ion o-f Assessments 



SKILLS; 



RATIONALE 



Interpret scoring techniques and score reporting -formats; 
communicate score interpretations to others e-f -f ect i vel y 

All tests should be both reliable and valid. However, since no 
test is technically per-fect, both random and systematic errors 
o-f assessment are always present. Errors o-f interpretation are 
also possible, such as invalid scoring and score re-ferencing 
(American Psv^chol ogical Association, 1985). Therefore, the 
strengths and weaknesses o-f test results -from a measurement 
pe'-spective should be a part of the interpretation process 
(American Personnel and Guidance Association, 1978). both on 
the part of the teacher for himself or herself, ana in 
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testrr. vtvf^dhe^- Hhould be ab'e to support v-cO^cil^ c-nric:; 
'^e^ labi 1 .t \ well an justi-^N the deciB^an ru . bv w'"[.icn the 
ecores c^r^ used 'vAmer iCc^n vxhoi 093 Cc^ 1 Ah oc: cKt 3 nr. , l^^'B":..' ; c- 
teacher UHina less tormal aBSSBsment tornr.ats should also be 
equipped to eval Uc^te and improve their +unct]oning since these 
results, too, are used in educational aec ision-mat ing . 



TOPICS: f-el lability and vc^l iditv evfiluation 
condinions wHich a-tfect reliability 
component \£.g., itemj anal/«3= 
interpretabil itv 0+ results 
e-t-ficiency of assessment -Forms ^e.g 

assessments , performance assessment 
reliabilitv o-f sums and di-f + erences 



and val idity 



, paper and pencil 

and oral Questions' 



C0MTEN1 



J^eedbact ^no G^-adlncl 



5f ILLS 



RATIONALE: 



TDPIC5 



Demonstrf^te and appl v techniques tor -feedback to Srtudents to 
iiTipnove their s^ 1 M s and to evaluate their progress; combine 
in-format 3 on into -forms appropriate -for grading 

Common educational uses o-f assessment include providing 
per-formance evaluations to students <and others) in various 
-forms, such as written and verbal comments, and grades. These 
become important determiners o-f decisions about students bv 
many individuals, including the students, themselves. because 
o-f the signi-f icance o-f these evaluations, they should be 
developed validly and used e-f-f ect 3 vel v . Thus, a teacher needs 
to be aware o-f the choices available -for -feedback and -for 
grading, and to be able to applv them appropriately (Stiggins, 
ConMjn, Br idcj^-f ord , Breen , and Brcdy, 19B7) . 

matching -feedbact with the purpose o-f the assessment 
written comments 
communication o-f test scores 
maH ing systems 
bases tor grading 

combining in format] on in grading 



CONTENT : 



Ethics o-f Assessment 



SKILLS: Evaluate the positive and negative e-f-fects o-f testing on 

individuals and groups; apply guidelines which promote 
eauitable testing practices 



RATIONALE: 



Whenever assessments are used, both use-ful and harm-ful outcomes 
are possible. Testir^g should be aone in an environment which 
supports maj i.num potential per^-f ormance and minimizes 
undesirable outcomes, and the results should be used in ways 
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commun icat mc; the ^-el:Mlrc: to other?:. I nowl ei^-qe o-^' aoDroorietB 

scoring tecnnsauei: c^n:: understc^nd ing o-f ^core repo-tang ^^rid 

rererencinc -fo^-mats are D'-ereauis i te to val lO use a.hc 
interpret at ] on . 

TOPICS: error in assessment and con-fidence bands 

limitations o-f soBcific measurement methods 
bias in assessment 

standardized score reporting systems transtormat loni^ and 

pro-f 1 1 Si: ) 
crommun i cat ] on ot resLP t s 

us]ng assessment to nroup students, gu]de teaching, and monitor 
progress 



Descr ::.Dt i on dt Assessrrien t Resu 1 t s 

Use tecihpiques tor data summarisation and display to draw 
cone 1 us ] ons 

RATIONALE: Drawing conclus]ons -from test results is best aone using 

-Formats and indices that clari-fy relevant features o-f data 
appropriately, requirjnc, sn understanding ot both the 
techniques, themselves, and the bases upon which they should be 
chosen. The American Association o-f Colleges o-f Teacher 
Education's (198S) outline of the knowledge base for the 
beginning teacher r^eflects this by including statistics and 
decision r,a^ ing related to measuremefit and evaluation results, 
along with interpretation of research and evaluat]on of 
instructional effectiveness within a chapter on evaluation. 

TOPICS: univariate -frequency distributions and graphical techniques (e,g., 
-freauency polygons, histograms, bar graphs, pie diagrams^ 
measures of central tendency (mean, median, mode) and variability 

(variance , standard deviation) 
percentiles and percentile ranks 
re+erencing normal d istri Put ions 

bivariate graphical techniaues (scatter diagrams, contingency 
tables, overlapping frequency polygons; e);pectancv tables-' 
correl ation and regression 



CONTENT : 
ILLS: 



CONTENT: Evaluation and Improvement of Assessments 



SKILLS: 



RATIONALE, 



Explain and apply methpdology for assessing the quality of 
measurements and techniques for improving them 

Assessments differ in auality. Given that measurement is done 
(Newman and Stallings, 1982; Stiggins, lc?S7.' , it should be done 
well. The methodology of evaluation of asfsessment tools can 
help to show how well a test is working and to provide 
information useful in its improvement. When using standardised 
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tr.c^.t protect the rjcihtc^ c^nd ^nl:^:•^-eEi:s o-f the students 'Amer3C£^n 
^•s /cnol ooxcc?" Hsso:: tuition . l^"^'S5: American Personnel .-nd 
bujd^^nce Assoc i c^t 3 on , l^''?E>; jcnnt Committee on Testing 
F^^actices, 1988;. An understanding o-^ the principles 
surrounding ethical use oi assessment is necessary m order to 
8Dd1v -fair te^s^tmg practices. 

T0P]C5: role D-F assessment ]n the academjc and ] nt erpet-soriai environment 
ot the cl ass^'^oom 

e-ftects D-f c^ssessment on the perceptions, behavior , ana mot] vat ion 
OT stuoent s 

published statements on responsibilities o-f test producers and 
users 

legislat]ve and judicial positions on testing 



A5:se = smenr EsBentia*" s ip ^'r ssn i one? " Eaacratior ot Tearherr: 
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